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•The ASDC at a Glance 
•ASDC Geospatial Architecture 
•Use Case - POWER/SSE 
•GDAL Enhancements for ESDIS (GEE) 
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Improving the Accessibility and Use of 
NASA Earth Science Data in Geospatial 
Applications 



• Many of the NASA Langley Atmospheric Science Data Center (ASDC) Distributed 
Active Archive Center (DAAC) multidimensional tropospheric and atmospheric 
chemistry data products are stored in HDF4, HDF5 or NetCDF format, which 
traditionally have been difficult to analyze and visualize with geospatial tools. 

• With the rising demand from the diverse end-user communities for geospatial 
tools to handle multidimensional products, several applications, such as ArcGIS, 
have refined their software. 


• Many geospatial applications now have new functionalities that enable the end 
user to: 

• Store, serve, and perform analysis on each individual variable, its time 
dimension, and vertical dimension. 

• Use NetCDF, GRIB, and HDF raster data formats across applications directly 

• Publish output within REST image services or WMS for time and space 
enabled web application development. 

• During this webinar, participants will learn how to leverage geospatial 
applications such as ArcGIS, OPeNDAP and ncWMS in the production of Earth 
science information, and in increasing data accessibility and usability. 
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The ASDC at a Glance 


• Provides data services for over 44 science projects 

• Primary: CERES, MISR, CALIPSO, ISCCP, SAGE III, MOPITT, TES 

• Distributes 300+ unique science products 

• In 2014, 624 Terabytes of data were distributed to over 165,000 
customers in 158 countries 

• 3.5 Petabytes of data are in the archive as of January 2015 

• Over 58 million files (1,537 TB) on high-speed disk for quick access 
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Radiation Budget - The radiation budget takes into account the 
sum of all radiation, transferred in all directions, through the 
Earth's atmosphere and to and from space. 

Instruments: CERES 

Clouds - A visible aggregate of minute water droplets and/or ice 
crystals in the atmosphere above the Earth's surface. 
Instruments: CALIPSO \ MISR 

Aerosols - Suspension of particles of condensed matter (liquid, 
solid, or mixed) in a carrier gas (usually air). 

Instruments: CALIPSO , MISR, SAGE III 

Tropospheric Chemistry - Measurements of chemical 
constituents in the atmosphere including the major (non-H 2 0) 
greenhouse gases (C0 2 , CH 4 , 0 3 , N 2 0). 

Instruments: MOPITT, TES 
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Data Discovery and Access through 
Web Services 



• Web services are used to make the application platform and technology 
independent by following standards, promoting interoperability 

• Data Access Protocol (DAP) Service 

• WCS (Web Coverage Service) 

• WMS (Web Mapping Service) 

• Webification Science (wlOn-sci) 

• ArcGIS Image Service 

• NASA's Enterprise License Agreement (ELA) with Esri allows the agency to 
acquire access to Esri ArcGIS software at no additional cost to programs 


• Examples of applications that support standards-based web services 

• Global Imagery Browse Services (GIBS) 

• Earthdata Search 

• Group on Earth Observations (GEOSS) Portal 

• Panoply 

• Integrated Data Viewer (IDV) 

• ArcGIS Platform Suite 

• Quantum GIS (QGIS) 
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What is the ArcGIS Platform? 



• ArcGIS is the geography platform 
enabling users to: 

• Create 

• Organize 

• Share geographic information and 
tools 

• With anyone by using intelligent 
online maps and useful apps. 


• These apps run virtually anywhere - 
on desktops, the web, smartphones, 
and tablets. 




Web Apps 




Desktop Web Device 

§□ 0 uJ 



Web GIS 



Server 



Online Content 
and Services 
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I Aj wimejiH Utilizing the ArcGIS Platform as an end- 
.9 iljucailf to-end solution for processing, analyzing, 

and visualizing NASA's scientific data 



HDF/netCDF/GRIB Data Warehouses 




ArcGIS Multidimensional 
Mosaic Dataset 




Enable ArcGIS Platform 



Web Apps 



Basemaps 



Models/Charts 



Editing 

Workflows 



Mobile Apps 


Aggregate (mosaic) spatial, time, and vertical dimensions 


• Create a seamless multidimensional cube from: 

• files representing different regions 

• files representing different time steps/slices 

• Spatial Aggregation 

• Temporal Aggregation 

• On-the-fly analysis 
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ArcGIS Multidimensional Mosaic 
Dataset 

Mosaic Index 




°BJ| 

Raster 

Name 

Variable * 

Standard Time 

Standard Z 


1 ll 

2 

<Raster 

hyc o m_g 1 b_reg p0 1 . nc : wat er_temp: 0 

waterjemp 

5/17/2013 

0 


<Raster 

hyc o m_g 1 b_reg p0 1 . nc : wat e r_t e m p: 1 

waterjemp 

5/17/2013 

-2 


3 

<Raster 

hycom_glb_regp01.nc:water_temp:2 

waterjemp 

5/17/2013 

-4 
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<Raster 

hycom_glb_regp01.nc:water_temp:3 

waterjemp 

5/17/2013 

-6 
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<Raster 

hycom_glb_regp01.nc:water_temp:4 

waterjemp 

5/17/2013 

-8 



A mosaic dataset allows you to store, manage, view, and query small to vast collections of 
raster and image data. It is a data model witnin the geodatabase used to manage a collection 
of raster datasets (images) stored as a catalog and viewed as a mosaicked image. Mosaic 
datasets have advanced raster querying capabilities and processing functions and can also be 
used as a source for serving image services. 

A mosaic dataset consists of 

• A catalog that provides the source of the pixels and footprints of the rasters 

• A feature class that defines the boundary 

• A set of mosaicking rules that are used to dynamically mosaic the rasters 

• A set of properties used to control the mosaicking and any image extraction 

• A table for logging during data loading and other operations 

• Optionally, a seamline feature class for seamline mosaicking 

• Optionally, a color correction table that defines the color mapping for each raster in the 
raster catalog 


Mosaic datasets utilize raster types to read and ingest the required information from raster 
datasets. It identifies metadata, such as georeferencing, acquisition date, and sensor type, 
along with a raster format. 
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Modeling with Raster Function 
Template (RFT) 



M Function Template Editor 


File 


Function Chain 


b-AL 

0-A Wind Chill 

I0--A Arithmetic time 
j H$ temperature 
0 A Arithmetic Function 
0--j fit Arithmetic time 
0-A Local Function 
windspeed 


0-A Arithmetic Function 
j-VJ* temperature 
0-A Local Function 
* windspeed 


General 

Fields 


Defaults 

Indexes 


Mosaic 


Editc 


Function C 


BA\ _ 

- ^ LandSurfaceTemperature 
0 A Plus32 

0-A Multiplylpoint8 
0 A Minus273 

(=) A MultiplySFpoint02 
A Mosaic Function 


On-the-fly processing 

• Arithmetic 

• Statistics 

• Reproject 

• Remap 

• Tassel Cap 

• Etc. 


• Functions allow the mosaic dataset to deliver a dynamically mosaicked image and they can be 
used to enhance the mosaicked image product by applying on-the-fly processing operations 
such as orthorectification, image enhancements, and image algebra. 

• You can add functions to the mosaic dataset or to individual rasters within the mosaic dataset, 
or they may be added when the data is added to the mosaic dataset. For example, when 
specific raster data products (such as from a satellite sensor) are added to a mosaic dataset, 
some functions are automatically added to the raster data. 

• This is advantageous, because it saves disk space, since you aren't required to store both 
source and preprocessed datasets. Additionally, if you wanted to process the same data 
differently, you can add the same data to a different mosaic dataset and apply different 
functions. 
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Spatial and Temporal Analysis 



Several hundred analytical tools available for raster, features, and table 

• Temporal Modeling 

• Looping and iteration in ModelBuilder and Python 


Create Winter Minimum Temperature Time Series 1870 - 2099 EXAM PLE 
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Visualization 



Visualize temporal change of a variable 

Visualize a variable at any vertical dimension 

Calculate and visualize flow direction and magnitude variables 
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End-to-End Solution for Processing, 
Analyzing, and Visualizing Data 



Mosaic Index 


OBJ 

Raster 

Name 

Variable * 

Standard Time 

Standard Z 

i 

2 

<Raster 

hyc q m_g 1 b_reg p0 1 . nc : wat e r_t e m p: 0 

waterjemp 

5/17/2013 

0 



hyc o m_g 1 b_reg p0 1 . nc : wat e r_t e m p: 1 

waterjemp 

5/17/2013 

-2 


3 

<Raster 

n y &9-rji _g 1 b_reg pQ 1 . nc : wat e r_t e m p:2 

waterjemp 

5/17/2013 



4 

Ngaster 

hyc o m_giti_r*g pO 1 . nc : wat e r_t e m p: 3 

waterjemp 

5/17/2013 

-6 


5 


hycom_glb_regp0l.i.c:water_temp:4 

waterjemp 

5/17/2013 

-3 





Visualization 




Modeling with Raster function template (RFT) 


J:( Function Template Editor 


Function Chain 


B fx Wind Chill 

Ez) fx Arithmetic time 
j - temperature 
B fx Arithmetic Function 
Bfx Arithmetic time 
j BJx Local Function 
L windspeed 
Id fx Arithmetic Function 
temperature 
B fx Local Function 
4 windspeed 


Mosaic 


General Defaults 

Fields Indexes Edit< 


[ear 

& 


Function Chain 


i9l LandSurfaceTemperature 
B Jx Plus32 

Bfx Multiplylpoint8 
Q fx Minus273 

&Jgg MultiplySFpoint02 
fx Mosaic Function 




Spatial and Temporal Analysis 


Create Winter Minimum Temperature Time Series 1870 - 2099 
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Multidimensional Mosaic in Web 
Applications 



The Scientific Data Discovery and Explorer 


tftli application highlight! some now capabilities In ArcGlS 10.3 nspportLng mKCttf, HDF and CRIB Scientific Datasets, 



Dead Zones in our Oceans 

Dead zone or hypoxia, refers to a reduced level of oxygen in the water. Less oxygen dissolved in the water is referred 
to as a “dead zone" because most marine life either dies, or, if they are mobile such as fish, leave the area. Habitats 
that would normally be swarming with life become a biological desert. (NOAA) 


Where are the Dead Zones? 


Hypoxic zones can occur naturally, but hypoxic areas also can be 
created or enhanced by human activity. There are many physical, 
chemical, and biological factors that combine to create dead zones, but 
nutrient pollution is the primary cause of those zones created by 
humans. 

Hypoxia may also occur in the absence of pollutants. In estuaries, for 
example, because freshwater flowing from a river into the sea is less 
dense than salt water, stratification in the water column can result. 
Vertical mixing between the water bodies is therefore reduced, 
restricting the supply of oxygen from the surface waters to the more 
saline bottom waters. The oxygen concentration in the bottom layer 
may then become low enough for hypoxia to occur. Areas particularly 
prone to this include shallow waters of semi -enclosed water bodies 
such as the Waddenzee or the Gulf of Mexico, where land run-off is 
substantial. In these areas a so-called "dead zone" can be created. 
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Create Story Maps 
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Graph 


World Soil Moisture Application 

Soil nwlsturo data from so 10 - aoi 2 Out was derived from NASA s GLOA 5 data product, Moan Monthly far d-ioo an from NOAH model. 
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• Tell the story of your 
scientific data 
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NASA ASDC ArcGIS Portal 
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LLERY MAP CROUP 5 P-^Y CONTENT MY ORGANIZATION 


Mult hew * 



NASA Atmospheric Science 
aSS 13 ' 1 ' Data Center (ASDC) 
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f Maps and Apps 




ng Temperature bp plobalFia diahort 

Sola^r lira di afire 


Q GEOPLATFORM.gov 


-DATA.GOV 
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Use Case: POWER Surface 
meteorology and Solar Energy (SSE) 



Objective: Integrate improved environmental data, analysis and modeling for 
enhanced management of energy production and energy efficiency systems. 


ATMOSPHERIC 

SCIENCE 

DATACENTER 


SCIENCE 


NASA Surface meteorology and Solar Energy - Choices 

Latitude 37 / Longitude -77 was chosen. 




Select parameters and press Submit 
(Default is ALL types) 


Submit [ Reset [ 


Geometry 

Latitude and longitude (center and boundaries) 



Average insolation 

Parameters for Solar Cooking 


Midday insolation 
Clear sky insolation 
Clear sky days 


Parameters for Sizing and Pointing of Solar 
Panels 

and for Solar Thermal Applications 


Insolation on honzontal surface (Average, Min, Max) 
Diffuse radiation on horizontal surface (Average. Min, Max) 
Direct normal radiation (Average, Min, Max) 

Insolation at 3- hourly intervals 

Insolation clearness index, K (Average. Min, Max) 

Insolation normalized clearness index 

Clear sky insolation 

Clear sky insolation clearness index 

Clear sky insolation normalized clearness index 

Downward Longwave Radiative Flux 


Solar Geometry 


Parameters for Tilted Solar Panels 


Solar Noon 
Daylight Hours 

Daylight average of hourly cosine solar zenith angles 

Cosine solar zenith angle at mid-time between sunrise and solar noon 

Declination 

Sunset Hour Angle 

Maximum solar angle relative to the horizon 
Hourly solar angles relative to the horizon 
Hourly solar azimuth angles 


Radiation on equator- pointed tilted surfaces 
Minimum radiation for equator- pointed tilted surfaces 
Maximum radiation for equator- pointed tilted surfaces 


Parameters for Sizing Battery or other Energy-storage Systems 


Minimum available insolation as % of average values over consecutive-day period 
Honzontal surface deficits below expected values over consecutive- day period 
Equivalent number of NO-SUN days over consecutive-day period 


°arameters for Sizing Battery or other Energy-storage Systems: 


Kquit alent Number Of NO-SUN Or BLACK Days (days) 


Lat 37 
Lon -77 

Jan 

jpeb 

Mar 

[Apr 

May 

Jun 

pul 

Aug 

Sep 

[oct 

Nov 

Dec 

[1 day 

0.96 

0.95 

0.95 

f 0.93 

| 0.91 

0.92 

0.95 

II so 

(L92 

"| 0.96 

0.94 

0.96 

3 day 

2.61 

‘| 2J8 

"| 2.46 

~\~ 2.66 

[ 2.47 

1.89 

| 2.16 

2.39 

2.07 

2J7~ 

2.46 

2.44 

[7 day 

5. OX 

4.51 

"| 453 

| 3.95 

4.48 

"| 3.33 

3.53 

3. 58 

3.61 

4.43 

| 358 

4.11 

1 14 day 

7.15 

6.14 

~| 4.08 

5 n 

'[ 6.77 

'1 435 

3.9X 

4.95 

4.57 

5.39 

4.74 

7.12 

21 day 

6.19 

8.35 

5XX) 

5.24 

7.35 

4 93 

5.12 

6.02 

3.70 

7.40 

5.82 

8.44 

Month 

4 60 

7.63 

"| 3.60 

5.26 

901 

3.67 

4.27 

5.24 

4.17 

6.81 

6.49 

6.65 


P a ramet er Dc fnirio n 


Meteorology ( T emperature ) : 


Monthly Averaged Cooling Degree Days Above 18° C 


[Laf37 
Lon -77 

Jan 

jpeb 

Mar 

Apr 

May 

Jun 

Jul 

\ug Sep 

loct 

Nov 

p. Annua) 

I 0 ” Sun. 

2 2 -year Average 

To- 

]| 0 j 

4 

?2 

86 

1X9 

257 

224 130 

34 

'\~5~ 

1 952 


Parameter Definition 

Meteorology (Wind): 


Monthl) Averaged Wind Speed At 50 m Above The Surface Of The Earth (m/s) 


Lat 37 
|Lon -77 

Jan 

Feb 

Mar Apr 

May 

Jun 

Eul 

Aug 

Sep 

Oct 

No\ 

Dec 

Annual 

Average 

1 0-ycar Average 

6.60 

6.71 

6.67 MM 

5.13 

4.88 

4.34 

4.17 

4.80 

5.38 

627 

6.65 

5*3 


Minimum And Maximum Difference From Monthly Averaged Wind Speed At 50 ni (%) 


Lat 37 
[Lon -77 

Jan 

jpeb 

Mar 

Apr 

May 

Jun 

Jul Aug 

Sep 

Oct 

Inov 

Dec 

Annual 

Average 

Minimum 

M3 

pir 

M4~ 

M0“ 

'1 -13 j 

Ml 

-10 ~M6” 

-8 

TT 

| 41 

Ml Ml 

Maximum 

13 

'j 8 

7 9 

15 

16 

9 

j TT ' io 

“nr 

‘ [ ~ 9 ~ 

'[ io”' 

7 fl 


• Limited graphical capability 

• Requires improvement to better 
serve customers 
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POWER SSE - GIS Web Application 
Enhancing Accessibility & Usability 




Cl Esri World Geocoder 


R3I 


Select the layer you want to swipe. 




Operational Layers 

p-j Maximum No-Sun or Black Day - January 

p-j Cooling Degree Days above 1 0° C - January 

p-j Cooling Degree Days above 18° C - January 

q Heating Degree Days below 1 8° C - January 

p-j Wind Speed at 50m vs 50m - Annual 

p-j Wind Speed at 10 Meters - Annual 

p-j % of Time Wind Speed (50m) above 1 8 m/s - Annual 

p-j % of Time Wind Speed (50m) 14-18 m/s - Annual 

p-j % of Time Wind Speed (50m) 10-14 m/s - Annual 

p-j % of Time Wind Speed (50m) 6-1 0 m/s - Annual 

p-j % of Time Wind Speed (50m) 2-6 m/s - Annual 

p-j % of Time Wind Speed (50m) 0-2 m/s - Annual 

p-j Wind Speed at 50 Meters - Annual 

p-j Top-of-Atmosphere Insolation - Annual 

p-j Clear Sky Global Radiation - Annual 

r - 1 Maximum Latitude Tilt Radiation - Annual 

| in 1 ► 


Q POWER Surface Meteorology and Solar Energy (SSE) 


Layer List 


httpy/p 


Earthstar Geographies 1 1 


power larc.nasac 


Temperature at 10 Meters - March 


High quality viewing (Desktop/Mobile) and printing 

Data Extraction/Subsetting 

Simultaneous Dataset Visualization (Swiping) 


Temporal Visualization 
Custom Color Ramps 

Pixel/Attribute Value Identification at Selected Location 
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Increasing Accessibility and 
Interoperability of NASA ESDIS Datasets 
with GIS Applications 

A Big Earth Data Initiative (BEDI) Project 

• To make ASDC data products easily accessible and interpretable by commercial and open- 
source GIS applications (Eliminate need for custom codes) This simplifies use of data by 
emerging applications community and modelers. It is transparent to the users. 

Objectives: 

• Identify the problems occurring in accessing MOPITT (HDF4 and HDF5) and TES 
(HDF5) level-3 data products by GIS software 

• Determine the causes of anomalies 

• Provide the solution framework to enable data access by GIS software 

• GDAL and HDF driver source codes 

• ArcGIS 10.2 and 10.3 Beta 




Sslsmsa 
Uju Samar 
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Geospatial Data Abstraction Library 
(GDAL) Enhancements 



In ArcMap 10.2.2 


ASDC Improvement 


Image Displayed Inverted 

MQP03TM.005 (HDF4) : 

Retrieved Surface 
Temperature Night 



Missing Geo-Reference 
& 90 Degree Rotated 

MQP03TM.006 (HDF5) : 

A Priori Surface 
Temperature Night 


Missing Geo-Reference 
& Cannot Display the 3D dataset 

TL3CQD.001 (HDF5) : 

CO 
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Geospatial Data Abstraction Library 
(GDAL) Enhancements 



Data visualization and Geoprocessing 


Rendering 

Capability 


File opening 
Capability 


Subset selection 
Capability 


ArcGIS 

plugin/ext. 



MOPITT 

products 


TES 

products 


Terra_Aqua 

products 


MISR 

products 


Revised GDAL HDF Drivers to 

allow for extending and 
additional functionality. 

Added functions such as Image 
rotator, 3D subset reader, geo- 
reference interpreter, and 
metadata repairer to set up the 

generic algorithm framework. 

Customized framework with 
Data product plugins that 
recognize file name patterns. 

Enabled image rendering and 
user workflow with an ArcGIS 
plugin / extension for testing of 
effectiveness of the improved 
GDAL. 
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DEMO 
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Improving the Accessibility and 
Use of NASA Earth Science Data 

2015 May NASA LaRC DAAC Webinar 


Matthew Tisdale, BAH, matthew.s.tisdale@nasa.gov 
Brian Tisdale, BAH, brian.e.tisdale@nasa.gov 


CONTACT US FOR BETA ACCESS 

ADD URLs for WEBSITES 
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